Additive/multiplicative free subordination 
property and limiting eigenvectors of spiked 
additive deformations of Wigner matrices and 
spiked sample covariance matrices * 

M. Capitaine^ 

Abstract 

When some eigenvalues of a spiked additive deformation of a Wigner 
matrix or a spiked multiplicative deformation of a Wishart matrix sepa- 
rate from the bulk, we study how the corresponding eigenvectors project 
onto those of the perturbation. We point out that the subordination func- 
tion relative to the free (additive or multiplicative) convolution plays an 
important part in the asymptotic behavior. 

1 Introduction 

This paper lies in the lineage of recent works studying the influence of some per- 
turbations on the asymptotic spectrum of classical random matrix models. Such 
questions come from Statistics (cf. [381) and appeared in the framework of em- 
pirical covariance matrices. In the pioneering work [11], J. Baik, G. Ben Arous 
and S. Peche dealt with random sample covariance matrices {Sn)n defined by 

Sn^^Yny;^ with y = j:IBn (i.i) 

where is a N x p complex matrix such that the entries {Bpf)ij are i.i.d 
centered standard Gaussian and E^v is a deterministic positive N x N matrix 
having all but finitely many eigenvalues equal to one. This model can be seen 
as a multiplicative perturbation of the so-called white Wishart matrix for which 
Eat = In- Besides, the size of the samples N and the size of the population 
p — Pn are assumed of the same order (as N ~^ oo, N/p — > c > 0). The global 
limiting behavior of the spectrum of Sn is not affected by such a matrix Ejy. 
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Thus, the hmiting spectral measure is the well-known Marchenko-Pastur law 
([42]) defined by 

MMP,c(da;) =max{l- ^, 0}5o + /(a;)l[(i_yj)2.(i+yj)2](a;)dx (1.2) 

with 

2'KCX 

When Sat — In, the largest eigenvalue of Sn converges towards the right hand 
point of the support of the Marchenko-Pastur law (see [3TJ HI [58]). When 
5] AT 7^ In, in [11] the authors pointed out a striking phase transition phe- 
nomenon for the asymptotic behaviour of the largest eigenvalue of Sn (at the 
convergence and fluctuations levels) according to the value of the largest eigen- 
value(s) of Sjv- They showed in particular that when the largest eigenvalue of 
Tin is far from one, the largest eigenvalue of Sn converges outside the limiting 
Marchenko-Pastur support. In 12 , J. Baik and J. Silverstein extended the re- 
sult of [111 on the convergence of the extremal eigenvalues of complex or real 
non necessarily Gaussian matrices Sn under finite four moments assumptions 
on the distribution of the entries oi Bn- 

When S'at is still defined by (|LT]) . but now the limiting spectral distribution 
of Sat is some compactly supported measure v on [0; -l-oo[, under finite second 
moments assumptions on the distribution of the entries of Bn, the spectral 
distribution of Sn converges almost surely towards a probability measure (Ilsd 
which only depends on c and denoting by gf^Lsni^) — I jh^d^,LSD{x) the 
Stieltjes transform of (J-lsd, for z e C^, guLsoiz) is the unique solution Z in 
{Z € C, -^i^ - cZ e C+} of the equation 

Z = I T7T^—^Mt) (1.3) 

J z — t[l — c + czZ) 

(see [HH [311101 Hi [Ml [ST]). Very recently R. Rao and J. Silverstein i47j and 
Z. D. Bai and J. Yao [S] dealt with such a model assuming moreover that Tn 
has a finite number of eigenvalues fixed outside the support of v called spikes 
(or converging outside the support of i/ in [47]), whereas the distance between 
the other eigenvalues of E^v and the support of f uniformly goes to zero. (Note 
that the assumptions in [47] are a bit more general) . Under finite four moments 
assumptions on the distribution of the entries oi Bn, the authors characterized 
the spikes of S^v that generate jumps of eigenvalues of Sn and described the 
corresponding limiting points outside the support of the limiting spectral dis- 
tribution ulsd of Sn- 

Several authors considered an additive analogue of the above setting that 
is, the influence on the asymptotic spectrum of the addition of some Hermitian 
deterministic perturbation A^r to the rescaled so-called Hermitian Wigner NxN 
matrix Wn- 
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Recall that, according to Wigner's work [551 [H] and further results of different 
authors (see [3] for a review), provided the common distribution fi of the entries 
is centered with variance cr^, the large TV- limiting spectral distribution of the 
rescaled complex Wigner matrix = -^Wn is the semicircle distribution fi^ 
whose density is given by 

^(-)-^v/^^Wl(-)- (1-4) 

Moreover, if the fourth moment of the measure /i is finite, the largest (resp. 
smallest) eigenvalue of converges almost surely towards the right (resp. 
left) endpoint 2a (resp. —2a) of the semicircular support (cf. [TU] or Theorem 
2.12 in [§]). 

Let An be a deterministic Hermitian matrix such that the spectral measure 
oi An weakly converges to some probability measure v and ||^Ar|| is uniformly 
bounded in N. When N becomes large, free probability provides us a good 
understanding of the global behaviour of the spectrum of Mjv = Xn + An where 
Xn is SL rescaled complex Wigner matrix. Indeed, the spectral distribution 
of Mjv weakly converges to the free convolution fia- S almost surely and in 
expectation (cf T, '43] and [5TJ [26] for pioneering works). We refer the reader 
to [53] for an introduction to free probability theory. 

Dealing with small rank perturbation of a G.U.E matrix W^, S. Peche pointed 
out an analogue phase transition phenomenon as in the sample covariance 
setting for the convergence and the fluctuations of the largest eigenvalue of 
M§ = W^/VN + An with respect to the largest eigenvalue 9 (independent of 
A^) oi An [45]. These investigations imply that, if 9 is far enough from zero 
{9 > a), then the largest eigenvalue of jumps above the support [—2a, 2a] of 
the limiting spectral measure and converges (in probability) towards pg — 9+^. 
Note that Z. Fiiredi and J. Komlos already exhibited such a phenomenon in [30] 
dealing with non-centered symmetric matrices. 

In [29], D. Feral and S. Peche proved that the results of [45] still hold for a non- 
necessarily Gaussian Wigner Hermitian matrix Wn with sub-Gaussian moments 
and in the particular case of a rank one perturbation matrix An whose entries 
are all for some real number 9. In [53], the authors considered a deterministic 
Hermitian matrix An of arbitrary fixed finite rank r and built from a family of 
J fixed non-null real numbers 9i > ■ ■ ■ > 9j independent of N and such that 
each 9j is an eigenvalue of ^jv of fixed multiplicity kj (with — They 

dealt with general Wigner matrices associated to some symmetric measure sat- 
isfying a Poincare inequality. They proved that eigenvalues of An with absolute 
value strictly greater than a generate some eigenvalues of Mn which converge to 
some limiting points outside the support of /io- . In [24] , the authors investigated 
the asymptotic behavior of the eigenvalues of generalized spiked perturbations 
of Wigner matrices associated to some symmetric measure satisfying a Poincare 
inequality. In this paper, the perturbation matrix is a deterministic Her- 
mitian matrix whose spectral measure converges to some probability measure u 
with compact support and such that An has a fixed number of fixed eigenval- 
ues (spikes) outside the support of v, whereas the distance between the other 
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eigenvalues and the support of v uniformly goes to zero as A'' goes to infinity. 
It is established that only a particular subset of the spikes will generate some 
eigenvalues of M^v which will converge to some limiting points outside the sup- 
port of the limiting spectral measure. The phenomenon is completely analogous 
to the one described in 23 and [5] in the sample covariance setting. 

Now, one can wonder in the spiked deformed Wigner matrix setting as well 
as in the spiked sample covariance matrix setting, when some eigenvalues sepa- 
rate from the bulk, how the corresponding eigenvectors of the deformed model 
project onto those of the perturbation. There are some results concerning finite 
rank perturbations: [U] in the real Gaussian sample covariance matrix set- 
ting, and [15] dealing with finite rank additive or multiplicative perturbations 
of unitarily invariant matrices. For a general perturbation, up to our knowledge 
nothing has been done concerning eigenvectors of deformed Wigner matrices. 
Dealing with sample covariance matrices, S. Peche and O. Ledoit [Hj introduced 
a tool to study the average behaviour of the eigenvectors but it seems that this 
did not allow them to focus on the eigenvectors associated with the eigenvalues 
that separate from the bulk. 

As already said, the limiting spectral distribution of the deformed Wigner 
model is described by the free convolution of the respective limiting spectral 
distributions. Moreover, the authors explained in [24 that the phenomenon 
of the eigenvalues separating from the bulk can be fully described in terms of 
free probability involving the subordination function related to the free additive 
convolution of a semicircular distribution with the limiting spectral distribution 
of the perturbation. Actually, as we will show below, the analogue results in the 
sample covariance matrix setting can also be described in terms of free prob- 
ability involving the subordination function related to the free multiplicative 
convolution of a Marchenko-Pastur distribution with the limiting spectral dis- 
tribution of the perturbation. Moreover, as already noticed by P. Biane in [20] . 
free probability again has something to tell us about eigenvectors of deformed 
matricial models. Indeed, in this paper, we are going to describe in the deformed 
Wigner matrix setting as well as in the sample covariance matrix one, how the 
eigenvectors of the deformed model associated to the eigenvalues that separate 
from the bulk project onto those associated to the spikes of the perturbation, 
pointing out that the subordination functions relative to the free additive or 
multiplicative convolution play an important part in this asymptotic behavior. 
Note that the proof is exactly the same in the additive and the multiplicative 
cases. 

In the sample covariance matrix model as well as in the deformed Wigner 
model, the convergence of the eigenvalues that separate from the bulk is de- 
duced from a striking exact separation phenomenon, roughly stating that to 
each gap in the spectrum of the deformed model there corresponds a gap in the 
spectrum of the perturbation, these gaps splitting in exactly the same way the 
corresponding spectrum. For general deformed models, that is, dealing with 
other matrices than Wigner matrices in the additive case or other matrices 
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than white Wishart matrices in the multiphcative case, such an exact separa- 
tion phenomenon is not expected in full generality. Nevertheless, we express all 
the results in this paper in terms of the free additive respectively multiplicative 
subordination functions since we conjecture that, for other deformed models 
than deformed Wigner matrices and sample covariance matrices, the limiting 
values of the eigenvalues that separate from the bulk as well as the limiting 
values of the orthogonal projection of the corresponding eigenvectors onto those 
associated to the spikes of the perturbation will be given by the same quantities 
provided one deals with the corresponding subordination functions relative to 
the limiting spectral distribution of the non-deformed model. By the way, note 
that one can check that the results of F. Benaych- Georges and R. N. Rao in 
|15j , concerning finite rank multiplicative or additive perturbation of a unitarily 
invariant matrix, about the convergence of the extremal eigenvalues and of the 
projection of the corresponding eigenvectors onto those of the perturbation can 
be rewritten in terms of subordination functions as conjectured. 

The paper is organized as follows. In Section 2, we introduce the additive 
and multiplicative deformed models we consider in this paper; we also introduce 
some basic notations that will be used throughout the paper. Section 3 is de- 
voted to definitions and results concerning free convolutions and subordination 
functions, some of them being necessary to state our main result Theorem 14.21 
in Section 4. Note that we present a common formulation for the additive and 
multiplicative deformed models and a common proof in Section 5 and Section 
6, postponing in Section 7 the technical results that need a specific study for 
each model. Finally, an Appendix gathers several tools that will be used in the 
paper. 

2 Models and Notations 

Let be a probability measure with variance cr^ which satisfies a Poincare 
inequality with constant Cpi (the definition of such an inequality is recalled in 
the Appendix). Note that this condition implies that /x has moments of any 
order (see Corollary 3.2 and Proposition 1.10 in [41]). In this paper, we will 
deform the following classical matricial models. 

• Normalized Wigner matrices = -^Wm 

such that Wm is a. N x N Wigner Hermitian matrix associated to the 
distribution /i: 

ij)i<j s-re i.i. d., with distribution /x. 

• Sample covariance matrices — ^B^B*^ 

such that Bn is a N x p matrix such that •\/25R((i?Ar)ij)i<i<Ar,i<j<p, 
i<i<N,i<j<p are i.i.d., with distribution /i. We assume that 
— — > c > when N goes to infinity. 
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For Wigner matrices, we will assume moreover that ^ is symmetric 

since wG will use results of [24^ where this assumption is needed. 

We will deform these models by respectively addition and multiplication by a 
deterministic Hermitian perturbation matrix Ap^; in the multiplicative per- 
turbation case, An will be assumed to be nonnegative definite. In both 
cases, we assume that: 
Assumption A: 

The eigenvalues 7^ = ^i{N) of A^ are such that the spectral measure fiA^ '■— 
■^J^iLi^ji weakly converges to some probability measure v with compact sup- 
port. We assume that there exists a fixed integer r > (independent of iV) such 
that An has N — r eigenvalues l3j{N) satisfying 

max dist(/3j(A^),supp(i^)) — > 0, (2.1) 

l<j<N—r A^— 7-00 

where supp(j') denotes the support of v. 

We also assume that there are J fixed real numbers 9i > . . . > 9j independent 
of N which are outside the support of and such that each 6j is an eigenvalue 
of An with a fixed multiplicity kj (with % ~ '')• ^j'^ ^'^^^ called 

the spikes or the spiked eigenvalues of ^^v- The set of the spikes oi An 
will be denoted by Q: 

e:={e,;...,9j}. 

In the sample covariance matrix setting we assume 6j > 0. 

We will consider simultaneously the two deformed models; 

M]^ = X^ + An^ 4tt^n + An, 
V A" 

= AIX^A% = ^A%BnB*nAI. 

When the approaches are the same for the two models we adopt the 
notation Mn standing for both and M^. When the studies are 

specific to one of the two models, we will use the superscripts. 

Actually, we assume without loss of generality in the sample covariance setting 
that the variance of /z is 1 since it corresponds to considering the rescaled matrix 

0-2 ■ 

Throughout this paper, we will use the following notations. 

- will denote the complex upper half plane {z € C, 9z > 0}. Similarly, 
wiU stand for {z e C, 5z < 0}. 

- For a function / differentiable in some neighborhood of a point x in R, we 
will denote by / (x) the derivative of /. 
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- For a vector subspace V of C^, we will denote by V"*" its orthogonal 
supplementary subspace and by Py the orthogonal projection onto V. 

- ( , ) will denote the Hermitian inner product on defined by (a, b) — b*a 
for any a, b in C^. 

- II II 2 will denote the Euclidean norm on C^. 

- We will denote by MmxqiC) the set oi m x q matrices with complex 
entries. || || will denote the operator norm and for any matrix M, ||M||2 = 
{Tr{MM*)}i. 

- For any matrix M in M7VxAf(C), we will denote its kernel by Ker(M). 

- Eij in Mmxqi'C) stands for the matrix such that {Eij)ki — 6ik6ji. 

- For any N x N Hermitian matrix M, we will denote by 



its ordered eigenvalues. 

- For a probability measure r on K, we denote by supp(r) its support and 
by '^supp(r) its complement in R. 

- For a probability measure t on R, we denote by gr its Sticltjes transform 
defined for z £ C \ R by 



- Gjv denotes the resolvent of Mn and qn the mean of the Stieltjes trans- 
form of the spectral measure of M^r, that is, 



where tr^v is the normalized trace: tr^r = -^Tr. 

When it is necessary to distinguish the deformed Wigner matrix setting 
and the sample covariance matrix one, we will specify the resolvent or 
the Stieltjes transform by using the corresponding superscript as follows: 



- C, K denote nonnegative constants which may vary from line to line. 

As already mentioned in the introduction, the assumptions on Wn and An 
ensure that they are asymptotically free, and then the spectral distribution 
of weakly converges to the free convolution /Zo- ffl almost surely and in 
expectation (cf [U|33] and [HIlll^ for pioneering works). 

Concerning the sample covariance matrix model M^, as already noticed in 
the introduction, its limiting spectral measure only depends on c and v. Note 



Ai(Af) > ... > AAr(Af) 




gN{z)=E{ti-NGN{z)), z e C\R, 
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that when the entries of are Gaussian (that is, if /i is Gaussian) we can 
assume that Apf is diagonal by the invariance under unitary conjugation of 
the distribution of X^. Then, since according to Gorollary 4.3.8 in [35], 
and An are asymptotically free, we can conclude that the limiting spectral 
distribution of is actually the free multiplicative convolution of 
the limiting spectral measure of X^, that is, /Imp c) with ly, denoted 
by /Xmp.c ^ J^- 

Thus, free additive and multiplicative convolutions provide a good under- 
standing of the limiting global behaviour of the spectrum of the above deformed 
models. Moreover, [iniliniHl] show us that free probability can also allow to lo- 
cate isolated eigenvalues of deformed matricial models. In particular, in [53], the 
authors point out that the subordination function relative to the free additive 
convolution provides a good understanding of the outliers of deformed Wigner 
matrices. We will see in this paper that the subordination function relative to 
the free (additive or multiplicative) convolution plays again an important part 
in the asymptotic behaviour of the eigenvectors relative to the outliers. We 
introduce in the following section some results concerning free convolution that 
will be fundamental later on. 

3 Free convolution 

Free convolutions appear as natural analogues of the classical convolutions in 
the context of free probability theory. Denote by M. the set of probability 
measures supported on the real line and by the ones supported on [0; -|-oo[. 
For n and v m M. one defines the free additive convolution /i ffl of /i and 
V as the distribution of X + Y where X and Y are free self adjoint random 
variables with distribution /i and u. For ^ and v in A^"*", the free multiplicative 
convolution /i Kl of /i and v is the distribution of XsKXs where X and Y 
are free positive random variables with distribution /i and v. We refer the 
reader to [53] for an introduction to free probability theory and to 09] [50] 
and [17] for free convolutions. In this section, we recall the analytic approach 
developped in [JS] [50] to calculate the free convolutions of measures, we present 
the important subordination property, and describe more deeply subordination 
functions relative to free additive convolution by a semi-circular distribution and 
free multiplicative convolution by a Marchenko-Pastur distribution. We also 
recall characterizations of the complement of the support of these convolutions. 

3.1 Additive Free convolution 

Let r be a probability measure on R. Its Stieltjes transform Qt is analytic on 
the complex upper half-plane C^. There exists a domain 

Da,p = {u + iv G C, |m| < av, v > j3} 
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on which g-r is univalent. Let Kt be its inverse function, defined on gT^Da^p), 
and 

Rriz)^Kr{z)-^. 

Given two probabiUty measures r and v, there exists a unique probabihty mea- 
sure A such that 

R\ = Rt + Ri' 

on a domain where these functions are defined. The probabihty measure A is 
called the additive free convolution of r and v and denoted by r ffl z/. 

3.1.1 Subordination property 

The free additive convolution of probability measures has an important property, 
called subordination, which can be stated as follows. 

Proposition 3.1. let r and v he two probability measures on R; there exists a 
unique analytic map 

p(a) .f^+^f^+ ^^^^ ^^^^ 

VzeC+, grfBuiz) = gAF^'^Kz)), (3.1) 

F'^''\z) = 5F('^)(z) > 5z, lim ^^^!M ^ i. 

y^+oo iy 

This phenomenon was first observed by D. Voiculescu under a genericity 
assumption in [52], and then proved in generality in |19| Theorem 3.1. Later, 
a new proof of this result was given in [T3], using a fixed point theorem for 
analytic self-maps of the upper half-plane. 

3.1.2 Free convolution by a semicircular distribution 

In [18], P. Biane provides a deep study of the free additive convolution by a 
semicircular distribution. We first recall here some of his results that will be 
useful in our approach. Let v he a probability measure on R. When r in p.ip 
is the semi-circular distribution fia-, let us denote by F^^j the subordination 
function. In [18], P. Biane introduces the set 

n^^u ■■= {u + iv eC+,v > Va,uiu)}, (3.2) 

where the function u^.i/ : R — > R^ is defined by 

The boundary of f^o-^^ is the graph of the continuous function v^^^. P. Biane 
proves the following 
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Proposition 3.2. fl^ The map 

Hcr^^-.zi — >z + a'^g^{z) (3.3) 



is a homeomorphism from fl^^i, to C+ U M which is conformal from onto 



inverse function of Ha.ii. 



c^^9p„ffli.(z) 

Considering i?o-,,/ as an analytic map defined in the whole upper half-plane C+, 
it can be easily seen that 

n,^, ^ {H„^,)-\<C+). (3.4) 

In the following, we will denote H„ i, by H to simplify the writing. 

Remark 3.1. Note that according to Provosition \3.S[ 

FW(M) = dn,^, = {u + iv,,,{u), ueM.} 

so that we have the following equivalence 

u e F^°2(M) n M Va,^{u) = 0. 

The following characterization of the elements of the complement of the support 
of V which are in the image of M hy F^m readily follows: 

u £ i^i^'j (M) n M \ supp {ly) u supp {v),H'{u) > 0. (3.5) 

In |18] . P. Biane obtains a description of the support oi jia- W v from which, 
when ^' is a compactly supported probability measure, the authors deduce in 
[24] a characterization of the complement of the support of /Xo- ffl involving the 
support of v and H. 

Proposition 3.3. 

X supp(^cr ffl !^) <^ 3it e O^"^ such that x = H{u) 
where O^") is the open set 

O^") := {uG"supp(i/), iJ'(M) >0} 

= |w supp(i^), j ^^^l^^y Mt) < 1 

Remark 3.2. O^"''^ C dn„^^ 

This readily follows from Remark l3. II 

Remark 3.3. Note that if ui < U2 are in {u G"^ supp {v),H'{u) > 0}, one has 
H{ui) < H{u2). Indeed, by Cauchy-Schwarz inequality, we have 



(3.6) 



H{u2)-H{ui) = (U2-Ui) 
> (U2-Ul) 



1-^2 



dv{x) 



{Ui - X){U2 - x) 



l-a^^{-g'M){-gl{u2)) 



> 0. 
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3.2 Multiplicative free convolution 

Let T ^ 6q he a probability measure on [0; +cx)[. Define the analytic function 



for complex values of z such that ^ is not in the support of r. "iir determines 
uniquely the measure r and it is univalent in the left half-plane {z € C, < 0}. 
Then one may determine an analytic function Sr such that 



z + 1 



Sr{z) 



in some domain (which will contain at least some interval to the left of zero) 
and then S'^gij^ = S^S^. (see [50]). 



3.2.1 Subordination property 

Free multiplicative convolution also presents a subordination phenomenon first 
proved in [19] (see also [l4]). 

Proposition 3.4. Let t ^ 5q and v ^ Sq be two probability measures on 
[0; +oo[. There exists a unique analytic map Fr^i^ defined on C\ [0; +oo[ such 
that 

Vz e C \ [0;+c»[, ^,^riz) = *.(F^:i^'(^)) (3.7) 

and 

Wz G C+, F^™)(z) e C+, f!^^Hz)^F^^\ arg(F^™)(z)) > arg(z). 



3.2.2 Multiplicative free convolution with a Marchenko-Pastur dis- 
tribution 

Let us determinate the subordination function relative to the free multiplication 
by a Marchenko-Pastur distribution. We can deduce from (|1.3p that for any 
z e C+, 

'^-^'^^'^ = / -t(i-c-HL,,_..(.))^^^^) ^'-'^ 

and then that Vz G C \ [0; +oo[, 

*MMP,cKl7.(2^) ^^t,(^z~cz + c9^^jp_^K„(^)^ . (3.9) 

Note that 

Z-CZ + C5^Mp ,K^(-) = .gr<,.„(-) 



z 

where Tc^i, is the limiting spectral distribution of ^B'^A^B 



N- 



11 



It is clear that Vz € C"*", ^r^^^d) G C+, gr^^{=) = 5Te.„(|)- Moreover, since, 
using p.Sp . we have 



(1 - c) + c / ^ / .i. c^KO 



it is easy to see that arg(g^^^(i)) > arg(z). 

Therefore, denoting by i^i™'' the subordination function in (I3.7P when r = /j.mp,c, 
we have that 

Now, we are going to present the characterization of the complement of the 
support of Tc_i/ provided by Choi and Silverstein in [25] . Note that the supports 
of Ump.c ^ and Tc.i, obviously coincide on ]0; +oo[. 

According to |7j p 113, for each z e C+, gr^ ^ (2) is the unique solution Z in 
of the equation 

Z = r^T — rvT (3-10) 

so that 

z ^ Z.^^igr^Jz)) (3.11) 

where 

ZcA^) = - + c / -^dv{t). (3.12) 
In the follov^ring, we will denote Z^jy by Z to simplify the writing. 
Proposition 3.5. \25f If u G'^ supp(Tc_^), then s — gr^ ^{u) satisfies 

1. s e M\{0}, 

2. i supp(i^), 

3. Z'{s) < 0. 

Conversely if s satisfies (1), (2) and (3), then u — Z{s) e'^ supp(rc.j/). 

In particular, letting z converge towards any element u of '^supp(Tc^,y) in (|3.1ip 
leads to 

u^Zigr^,^{u)). (3.13) 
In [25j . the authors proved also that lim ^ ^ ffr^ ^.iz) = gr^ „(u) exists for 

zeC+ 

any u in M\ {0}. 

We include here for the convenience of the reader some basic facts that will be 
used later on. 
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Remark 3.4. For any m G R \ {0} such that gT, „{u) e K \ {0} and ^ ^ ^.^^ 
supp {ly), we have Z[gT-^ ^iu)] — u. 

This readily follows by letting z goes to u in p. lip . 
Let us introduce the open set 



u supp(iy) \ {0}, Z (-) < 



u supp(i') \ {0}, c j 



;dv(t) < 1 



(3.14) 



(u-t)^ 

Remark 3.5. For any u in 0^'^\ 5r,.„[-Z(^)] ^• 

Let us prove Remark 13.51 According to Proposition 13. 5[ for any u € 
2'(f ) e'^ suppfrc u) and then according to the same Proposition 13.51 L, i 

also belongs to O^™). Now, for any a 7^ 6 in O^™), 



Z{\)^Z{-) = {b-a) 
a 



by Cauchy-Schwartz inequality, 
t^ 



1 - c 



(a - t){b-t) 



dv{t) 



{a-t){b-t) 



dv{t) 



< 



[a - ty 



{h-ty 



(3.15) 



:dv{t) p.l&) 



< 1. 

Hence we can conclude that 



for any a ^ & in O^"), Z{h ^ Z{-). 

b a 



(3.17) 



Since using p.l3p we have Zlg^ [Z{-)]] — Z{-), we can then deduce that 

5..,„[2(i)] = i □ 



Remark 3.6. Using i3.15\) and i3.16]) . we have for any a < b in the set 

{u^O,u suppiiy), Z'(i) < 0} that Z(i) < Z(i). 

Remark 3.7. For any u G +oo[, we have -Z(i) > 0. 

Indeed, assume that Z(i) < 0. According to Proposition lXSl Z{^) G'^ supp(Tc^^); 
-2(:^) < implies that Z{^) is on the left hand side of supp(rc^iy) and therefore 
that g^ {Z{-)) < 0. This leads to a contradiction with Remark |3 . 51 saving that 
ff..„(2(i)) = i>0. 

Remark 3.8. For any u ^ in '^supp (v) such that Z {-) > 0, we have 
i^5r.,„(K\{0}). 
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Indeed, let us assume that there exists u € R \ {0} such that i = gTa,^{f^)- 
According to Proposition I3.5[ v belongs to supp(rc_^). Using Remark [3^ since 
9ra.„{'^) G K \ {0} and - — G'^ supp {v), we have Z[gT^^^{v)] = v. It follows 
that for any y > 0, 



1 = 



2^[5rc,.(w + jy)] - Z[gr^ Sv)] 



ly 



z^idr^.A'" + iy)] - 2:[9t^.Jv)] gr^,Av + iy) - gr^,Av) 



ly 



(3.18) 



Since g-r^ ,^ {v + iy) converges towards gr^ ^{v) = i and Z is holomorphic in a 
neighborhood of 5rc„(^^); letting y tends to zero the first factor on the right 
hand side of (|3.18l) converges towards Z [gr^ „(w)) = Z {-) > 0. This implies 



that 



ly 



converges towards 



Now, for any y > 0, we have 

„ (u + iy) - gr^ 



3? 



{v) 



ly 



> when y tends to zero. 



Xv)] 



y 

%re.„ (w + iy) 



< 



which leads to a contradiction. □ 



4 Main results 

As noticed in the previous section, we have the following characterization of the 
complement of the support of the limiting spectral distribution of . 

X supp(/i^ Siy) ^3ue such that x = H{u). (4.1) 

Moreover, we can deduce, using Proposition 13.21 and Remark 13.21 that : 
X I— >■ F^^j (x) is a bijection from '^supp(/io. ffl ly) onto O^"-* with inverse H. 

Since the supports of ^mp.c ^ and Tc,i, coincide on ]0; +oo[, we can also deduce 
from the previous section the following characterization of the restriction to 
M \ {0} of the complement of the support of the limiting spectral distribution 
of M^: 

x^O,xe'' supp(AiMP c Kl I/) 4^ 3u e 0^"'\Z(-) ^ 0, such that x = Z(-). 

u u 

(4.2) 

Moreover, we can deduce from Remark 13.41 and Remark 13 . 5 1 that : 

X f]™^ (i) {— gTa,i,{^)) is a bijection from '^supp(^MP,c z^) \ {0} onto the 

set e ©("^^(i) ^ 0} with inverse Z. 
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Note that the limiting mass at zero was studied in |25) : 



^(0) = 



v{0) if c(l 
1 



^(0)) < 1, 
-i.(0))>l. 



i if c(l 

Actually, according to [21] (resp. [47l|9]), the spikes 6j in 6 = {6*1; 



/}of 



the perturbation matrix An that will generate eigenvalues of (resp. M^) 
which deviate from the bulk are exactly those belonging to O^"-* (resp. C^™)) 
and the corresponding limiting points outside the support of /^o- ffl (resp. Tc^^) 
will be given by H{6j) (resp. Z{j-)). Note that the results in f4T,W are not 
formulated in that way since the authors do not deal with subordination func- 
tion but as already mentioned we choose to express all the results using these 
functions H and Z related to the subordination functions for further general- 
izations. Hence adopting the notations of the first column of the following array 
standing for both the corresponding elements of the second column (deformed 
Wigner matrix case) and the third column (sample covariance matrix case), we 
can present a common formulation of these results. 



Mn 






A^LSD 


/io- ffl 












enc'f'^) = {9, e Q,H'{ej) > o} 


eno(™) = {e^ e e,z'(f) < o} 


P0O 




2(i) 



Theorem 4.1. 



Let 9j be in Oo and denote by fij^i + 1, . 



(4.3) 



Then the kj eigen- 



the descending ranks of 9j among the eigenvalues of An- 
values (A„^._j+i(MAr), 1 < i < kj) converge almost surely outside the support 
of fJ-LSD towards po- . Moreover, these eigenvalues asymptotically separate from 
the rest of the spectrum since (with the conventions that Ao(Afjv) — +00 and 
Xn+i{Mn) = —00) there exists < Sq such that almost surely for all large N, 



K.-AMn) > POi +5o and A„ 



< 



(4.4) 



The aim of this paper is to study how the corresponding eigenvectors of the 
deformed model project onto those of the perturbation. Here is the main result 
of the paper still adopting the notations of the first column of the array (|4.3p 
in order to present a unified approach. 

Theorem 4.2. Let 9j be in Oo md denote by rij-i -I- + kj the 

descending ranks of 9j among the eigenvalues of An- Let ^{j) be a normalized 
eigenvector of Mn relative to one of the eigenvalues (A„^_j+g(il/7v), I < q < kj). 
Then, when N goes to infinity, 



ft) 



P 



Ker (9jiN-Ai 
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where 

Note that we have explicitly 



N- 



H' 



1 



9j - x)^ 



(ii) for any 9i in Q\ {9j}, 



P 



Ker (9iIn-Am) 



(4.5) 



Example: Let us consider the perturbation matrix 

Aw = diag(2,^,0,-l,...,-l,l,...,l) 



whose hmiting spectral distribution isv = ^(5i + |(5_i. Thus, the set of the spikes 
of An is Q = {2;|;0}. Let us consider the corresponding deformed Wigner 
model assuming moreover that = i. Then, H{u) = u + j (^^-1) + 1 (u+i) ■ 
One can check that the support of uj_ fflz^ has two connected components which 

are symmetric with respect to zero. Since H' {2) = ^ > and 2 is the largest 
eigenvalue oi Ajy, according to Theorem 14. 1[ when N goes to infinity, the largest 
eigenvalue of the deformed Wigner model converges almost surely towards 
H(2) — I (on the right hand side of the support of fij^ ffl v). Note that, since 

7?'(|) < 0, the second largest eigenvalue of sticks to the bulk. Moreover, 
since iJ'(O) = ^ > and the descending rank of among the eigenvalues oi An 
is -jj according to Theorem 14. li when N goes to infinity, Ajv(Mjy') converges 
almost surely towards H{0) = which is between the two connected compo- 
nents of the support of ffl i^. Now, denote by {ei, . . . , eAr} the canonical 

basis of C^. Since ei is an eigenvector relative to 2, 62 is an eigenvector rela- 
tive to I and 63 is an eigenvector relative to 0, according to Theorem 14.21 if ^ 



2 

denotes a normalized eigenvector associated to the largest eigenvalue of Mjy , 
*S = (^(1) , . . . , , then 1^(1) I yiF(2) = ^ and, for z = 2, 3, IC^'^ | 
when A'' goes to infinity. Similarly, if ^ denotes a normalized eigenvector asso- 
ciated to A«(M]f), (^(1),...,^^^^), then /?F(0) = ^ and, for 

i = 1,2, |^(*^| ^ when N goes to infinity. 
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Actually, in order to establish Theorem 14.21 we will first prove Proposition 
l4.1l below since when kj ^ 1, the method used in this paper does not allow us to 
tackle directly the orthogonal projection of each eigenvector separately to prove 

(i)- 

Proposition 4.1. Let 0j be in Oo and denote by rij-i + 1, . . . + kj the 

descending ranks oj 9j among the eigenvalues of An- Denote by ■ ■ ■ ,S,kj (j) 

an orthonormal system of eigenvectors associated to (A„^_j+„(Mjv), 1 < n < 
kj). Then, for any Oi in Q, when N goes to infinity, 

II ^ 
H VKer (9,7„_A„)^"0') 2 ^i,3kjT{e,) 



n=l 



where T{9j) is defined by ^.5^ . 

In Section [Sj we will explain how we can deduce (i) of Theorem 
Proposition 14.11 using a perturbation trick and ideas of [28] . 



5 Reduction of the proof of (i) of Theorem 14.21 
to the case of a spike with multipUcity one 

Note first that, dealing with a spike 0j in Qo with multiplicity one, the state- 
ments of Theorem 14.21 and Proposition 14.11 are equivalent. Thus, in this section, 
we show how to deduce (i) of Theorem 14.21 dealing with a spike 9j with mul- 
tiplicity kj 7^ 1 from the hypothesis that (i) is true dealing with a spike with 
multiplicity one. We will need the following lemmas. 

Lemma 5.1. Let V be a vector subspace of with an orthonormal basis 
Vi, . . . , Vfc. Let a be in [0; +oo[. For any m = 1, . . . ,k, let a^n be in [0; -t-oo[. Let 
E be a vector subspace of with an orthonormal basis ^i, . . . Then, there 
exists a sequence apf > 0, depending on the \ (Vi, £,n)\, ocm, i,n,m Q {1,..., k}^ , 
such that, for any vector u in the unit sphere of , 



\Pvu\\l 



k 

< {2k + a) ||PBJ_ii||2 + max jam — a| -|- a^r, 

m— 1 



and, if, for any m,n in {1, ... , k}^ , 

|(Ki,Cri)P Srn,nam whcn N gocs to infinity, (5.1) 
then On converges to zero when N goes to infinity. 

Proof: Throughout the proof, we will often use the following obvious inequali- 
ties without mentioning them: 

for any vectors ui and U2 in the unit sphere of C"'^, |(itiU2)| < ||ui||2 IIM2II2 = 1j 

\{PeUi,U2)\ < IIPBU1II2 11^2112 < Il"l|l2 h2|l2 = 1- 
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Wc have for each m in {1, . . . , fc}, for any vector u in the unit sphere 



\{u,Vm)\^ ~ \{Peu,V^)\' 



= \{\{u,Vrn)\ - \{PeU,V^)\)\ 

X i\{u,V„,)\ + \{Peu,V^)\) 

< 2|( \{u,V^)\-\{PEU,V,n)\)\. 



From 



{U, V,n) = {PeU, V,n) + {Pe^U, y,„), 

it readily follows that 

I \{u,V,„)\~\{Peu,V^)\ \ < \{Pe^u,V^)\ . 
and readily yield 



\{U,V^)\^ - \{PEU,Vm)\^ < 2\{Pe±U,V^^ 



< 2||PB^M||2||Kn||2 

< 2||Pb^m||2. 



Now, we have that 



n ^ 1 
n ^ m 

{u,£,m){£,m,V,n) + A„(m) 



where 



Then, 

with 

Thus, 



\Arniu)\< J2 

n = l 
n 7^ m 



\{PEU,Vm)\^ = \ {u,^m)f\{U,Vm)\^ + 



|V,„(u)| < 2|A„,(u)| + |A„,(u)r. 

+ (a„i - a) |(u,Cm)|^ 
+V™(u). 
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Now, using that 



1 = Il"ll2 = 1^"'^" 



f + \\PE^u\\l., 



we have 



m=l 



and then 



J2 [\{u,V„,)\'-a\{u,U)\' 

7n—l 

-a\\PE±u\\l 



E [\{u,V^)f - \{PEU,V,n)f 



+ J2 [\{PEU,V„,)\^-a\{u,^^)\^ 
-a \\Pe±u\\1 . 

Using ([5^ . (lO)) . ((5?8t . ((531) and (fO)) . we immediately get that 



J2\{u,V,n)\'-a 



m—1 



< 2k\\PE±u\\^ 
+a \\Pe±u\\: 



+ max \a,n — Oi\ 

m—1 

+aN, 



with 



rn/ 1 L*m 



-2 E i(^-^™)i+E 

m, 71 = 1 
n ^ TO 



/ 

n = 1 

y 71 7^ TO 



(5.9) 



(5.10) 



Now, if (|5.ip is satisfied, that is, for each ?ti, n in {1, . . . , fc}^, when N goes to 
infinity, 

it is clear that un converges towards zero when N goes to infinity. Lemma |5. II 
follows. □ 
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Lemma 5.2. Let Mjv be an Hermitian N x N matrix. Assume that there is a 
sequence {n{N)) pf>Q in N and a fixed positive integer number k, such that for 
any I — 1, ... ,k, A„(7v)+i(Afjv) converges towards p G M when N goes to infinity 
and there exists 6q > such that, for all large N, 

K{N){Mn) > p + Sq and \n{N)+k+i{MN) < p - Sq (5.11) 

(with the conventions that Ao(Afjv) = +oo and Xn^i{Mn) — —oo). For any 
< e < eo, let A/jv(e) be an Hermitian N x N matrix. Assume that there exists 
ft ^ 0, independent of N , decreasing to zero when e decreases to zero, such that 
for all large N , for any < e < eo, 

||AfAr(e)-M|| </,. (5.12) 

Let < eo < eo such that /g„ < Then for all large N , for any < e < eo, 
for any I = 1, . . . ,k, 

|A„(jv)+i(Mw)(e)-p| < y, (5.13) 

6 S 
A„(jv)(^w(e)) > P+ y and \n(N)+k+i{MN{<^)) < P - (5.14) 

and for any normalized eigenvector of Mn relative to the eigenvalue A„(jv)+i(AfAr) 
for some I in {1, . . . , k}, 

II II 2 I 

||-PE(c)i?||2 < ^ {/£ + \KiiN)+l{MN) - P\} , 

where E{e) denotes the vector subspace generated by the eigenvectors relative to 
the eigenvalues Xn{N)+q{MN{^)), q_ — 1, . . . , fc. 

Proof: According to Weyl inequalities (see Lemma 18.41 in the Appendix) and 
for all large iV, for all < e < cq, 

A„(jv)+/(MAr(e)) < A„(Ar)+,(M7v) + for ; = l,...,fc + l, 

K(n)+i{Mn{())> K(n)+i{Mn) - fe, for ; = 0,...,fc. 
By assumptions of the lemma, for all large N , for any I ^ 1, . . . , fc, 

|A„(W)+/(iV/Ar) - p| < y, 

and for all large N, 

K(n){Mn) > p + 5o and \n(N)+k+i{MN) < p-So. 

Hence, choosing < eo < eo such that /j^ < ^ , (15.141) and (I5.13P readily follow. 

For all large N and any < e < eo, let ^i(e), . . . ,Cfc(e) be an orthonormal 
basis of E{e) such that there exists a,ii N x N unitary matrix V{e) whose k first 
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columns are ^i(e), . . . , ^fc(e) and a {N — k) x (N — k) diagonal matrix A2(e) such 
that 

where 

Ai(e) = diag (A„(Ar)+i(AfAr(e)), . . . , A„(Ar)+fc(Mjv(e))) • 

Let ^ be a normalized eigenvector of Mjv relative to the eigenvalue Xn{N)+iiMN) 
for some I in {1, . . . , fc}. Let us set 

R{e) := (Afw(e)-p/jv)e 

We have 

«(.)^n.)(^'<tor'' A^-W^h-n- 

Define the vector wi(e) in C*^ and the vector W2(e) in C^^'' by setting 
Note that 



1^2(6) 



Il«2(e)|l2- ||^£(e)-^||2- (5-15) 

According to (|5.14p . for all large N, for any < e < eq, for all i ^ {n{N) 

So 
2 



1, . . . , n{N) + fc}, |Ai(A/jv(e)) ~ p| > % > and therefore p is not an eigenvalue 



of A2(e). Then 

«2(e) - (A2(e) - plN-kV^ [V*ie)R{e)]^N_k)xi 

where [V*{e)R{e)](N^k)xi denotes the vector obtained from F*(e)i?(e) after 
removing the first k components. Hence 

\\v2ie)\\,<^\\R{e)\\,. (5.16) 

Now, we have 

||i?(e)||2 = \\{MNie)-MN + MN-plN)a2 

< \\MN{e)-MN\\ + \Xn(N)+l{MN)-p\ (5.17) 

Lemma [O] readily follows from ((ET^ . ^JE^i, (ISTT)) and ((??T^ . □ 

Let us define the continuous function r on O^"''' respectively ©'^'"^njO; +oo[ 
by setting 

Assume that 9j in Go is such that kj ^ 1. Let us denote by Vi{j), . . . , Vk^ (j), 
an orthonormal system of eigenvectors of An associated with 6j. There exists 



21 



an N X N unitary matrix U whose kj first columns are Vi{j), . . . , 14^. (j) and a 
{N — kj) X {N — kj) Hermitian matrix D such that 

Let us fix eo such that < eo < min^^j^ distiOg, supp v U^^s 0%) and [9j] 9j + 
fcj-eo] C O. For any < e < eo, let us consider 



Ajv(e)^XAr^jv(e)^ if ^AT = 



where 



Of course for any < e < eqi the limiting spectral distribution of An{€), when 
goes to infinity, is the same as the limiting spectral distribution of Af^. 
Moreover, for all large N , the descending ranks rtj_i + 1, . . . , + fcj of 6j 
among the eigenvalues of Aj^ are the ranks of Oj + fcj-e, . . . ^6j + 2e, 9j + e among 
the eigenvalues of Ajv(e). For each m in {1, . . . , fc^}, Kn(j) is an eigenvector of 
Ajv(e) associated with the eigenvalue 9j + {kj — m + l)e which is of multiplicity 
one. Note that, since A^ satisfies Assumption A, there exists a constant C 
such that for any < e < eo, supN \\AN{e)\\ < C . ft is easy to see that 

r ek, ifXN^X^, 
llM^(e)-M^||< eiiXj^^X^. 



According to Theorem 5.fl in 7 , ||Ar^|| = c(l + --^)^ + Oa.s.Ni^)- Thus in 
both cases, there exists some constant C\ such that a.s for all large N, for any 
< e < eo, 

||MAr(e) - Mjvll < Cie. (5.18) 

Let ^ be a normalized eigenvector of Mn relative to A„^_j+g(Afjv) for some 
g in {1, ... , kj} . Let < eo < eo be chosen such that CiCq < ^ where do is 
defined in Theorem l4.1l Using Theorem l4.1l and (I5.18p . according to Lemma lST^ 
almost surely for all large N, for any < e < cq, the set {A„^._i+„(MAr(e)), n G 
{1, . . . , kj}} is distinct from the set {Ai(MAr(e)), i ^ {rij-i + 1, . . . , rij-i + kj}} 
and 

\\PEie)^^\\2 < |^{Cie+|A„,_,+,(Mw)~Pe,|}, (5.19) 

where E{e) denotes the vector subspace generated by the eigenvectors relative 
to the eigenvalues A„^_j+„(Afjv(e)), n — 1, . . . ,kj. Define 

^ 2(2fcj-+T(g,-)) ^^^ ^ 1^^^^ ^ _ ^^^^^1 20) 

Oo ™=1 
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For any C > 0, choose and fixO<e = ei <eo such that 

0<4ei)<| 

(using the continuity of the function t at the point 9j). 



(5.21) 



Now, each 9j + hi, I e {1, . . . , kj}, is a spike of AN{ei) with muhiphcity one. 
According to Theorem 14.11 for n g {1, . . . , kj}, A„j_^+„(MAr(ei)) asymptotically 
separates from the rest of the spectrum and converges almost surely towards 
H{9j + {kj — n + l)ei); moreover, if ^n{ii,j) denotes a normalized eigenvector 



associated to A 



(MAr(ei)), Proposition 14. 1 1 implies that 



\{VmU).U^i,.m^ S,n,nTi^j + {k, - m + l)ei). 

According to Lemma l5.ll there exists a random variable a^f (ei) > 0, converging 
almost surely to zero when N goes to infinity, such that, almost surely, for all 
large A^, 



^Ker (0j7„_A„)^ 



< (2% + T{e,)) \\PE(e,)^£.\\^ + aniei) 
+ max^^i |r(6'j + mei) - T{6j)\ . 



The last inequality, (|5.19p and (|5.20p readily yield that, almost surely, for all 
large A'', 



-^Ker (6»,7jv-An)^ 



+aN{ei) + t(ei). 



Therefore, (I5.21[) . the almost surely convergence of A„^._j+g(Afjv) towards 
and of ajv(ei) towards zero imply that, almost surely, for all large A^, 



°Ker (Sj/jv-Ajv)^ 



<c 



and the proof is complete. 



□ 



6 Proof of Proposition 14.11 

Since the proof of Proposition 14. 1 1 is exactly the same for the deformed Wigner 
model and the sample covariance matrix, in order to present a unified approach 
of this proof, we adopt in this section the notations of the first column of the 
array (|4.3p standing for both the corresponding elements of the second column 
(deformed Wigner matrix case) and the third column (sample covariance matrix 
case). We postpone in a later subsection the technical results that need a specific 
study for each model in order to not lose the thread of this common proof. 
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6.1 Restriction to the asymptotic behavior of some expec- 
tation ETr [/i(Mjv)/(Ajv)] 



The aim of this first step of the proof of Proposition [471] is to reduce the study 

k- ^ 
of the asymptotic behaviour of -^Ker (e,/2v-Ajv)^"(-^) *° ^'^^ 

expectation ETr [/i(M7v)/(^Ar)] for some functions / and h respectively concen- 
trated on a neighborhood of 9i and pe^ ■ We will use the convergence results 
on eigenvalues described in Theorem 14.11 above and concentration inequalities 
presented in the Appendix. 

P. Biane already suggested in [20] to evaluate the moduli of the Hermitian inner 
products of the eigenvectors on test functions. Indeed, for any smooth function 
h and / on M, denoted by ui, . . . , un (resp. wi, . . . , wn), the eigenvectors asso- 
ciated with Ai(^jv), . . . , A7v(^Ar) (resp. Ai (M^r), . . . , Xn{Mn)), one can easily 
check that 

TT[h{MM)f{AN)]=Y.h{Xk{MM))f{MANmu^,Wk)\^. 

k,i 

Thus, since 9i on one hand and the A„ ._^+„(M7v), n = 1, . . . ,kj, on the other 
hand, asymptotically separate from the rest of the spectrum of respectively An 
and Mjv, a fit choice of h and / will allow the study of the restrictive sum 

k ^ 
J2n=i ^Ker (ei/jv-Ajv)^"(-^) 

Let us fix 

1 

< 77 < - mindist{9s, supp v Ui^s Oi) 
2 s—i 

and for any Z = 1, . . . , J, choose fn.i in C°°(K, M) with support in [61 — ri,9i + rj] 
such that Jq,i{9i) = 1 and < < 1. 

For any 9i € C'('^\ according to Remark 13. 2[ 9i belongs to and accord- 
ing to Proposition 13.21 Fa'^},{p0.) = 9i. For any 9i e C^^'njO; +oo[, according 
to Remark 13.71 pe- = Z{j-) > and according to Remark 13.51 „{pei) — j- 

s° ^^^^ f'-^U^) ^ 

According to Theorem 14. 1[ there exists (5o > such that almost surely for all 
large N, for all 9j in 0o, 

A„,_i(MAr) > pe^ + So and Xn^^i+kj+iiMN) < pe, - S^- 

Let us fix 

< (5 < ^min{(5o, dist {pe,,S), \p0^ - pet\,s ^ t, {9s, 9t) G Ol}, 

where 

supp (Aiffli^) if Ma, = 



S = 



supp {tc,u) U {0} if Ma, = M^ 



N 
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For any j such that 6j £ 60, choose hs,j in C°°(IR, M) with support in [pg. 
S, pej + 6] such that hs,j = 1 on [pg. - f , + f ] and < hs,j < 1. 

Lemma 6.1. When N goes to infinity 



Proof: According to Theorem 14.11 there exists some set ft of probabihty one 
such that on ft, for aU large N,\/i — 1, . . . ,kj, 

A„^._i(MAr) > P0^ + S, \nj-i+k,+liMN) < pg. - 5. 

Using also the assumption (|2.ip on the /3i{Nya, we have that on ft, for all large 

N, 



Hence, Lemma [6.11 follows . □ 

Now, according to Lemma [Q] Remark l8. II and Lemma ITTl] the random vari- 
ables F^f = Tv[hs,j{M]^)fr,AAN)] and F§ = Tr [/i5j(M^)^,z(A^)] satisfy 
respectively the following concentration inequalities 



Ve > 0, P - E{F^)\ >e) < exp 



Ve > 0, P - E(Fi^)| > e) < i^i exp 



,j\\Lip i 

fV^ ' 

Lip 



(The constants have been introduced in Lemma [01 and Lemma [73J. By Borel- 
Cantelli Lemma, we can readily deduce the following lemma. 

Lemma 6.2. 

Tr [hs^AMN)hAAN)] - E [Tr [hs,,{MN)fr,MN)]] 0. 

Lemma 16.11 and Lemma 16.21 allow us to conclude this first step of the proof 
by the following result. 

Proposition 6.1. For any 9j in Qo and any 9i in Q, when N goes to infinity 



E \\PKer iej.-A.)Uj) - E [Tr [/i,,,(A/^)/,,,(A^,)]] ^-^ 0. 
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6.2 Making use of estimations of the resolvent 

The basic idea of this second step of the proof of Proposition 14.11 is to approx- 
imate the function hsj by its convolution by the Poisson Kernel in order to 
exhibit the resolvent of the deformed model and then use sharp estimations on 
this resolvent. 

Lemma 6.3. For any continuous function h with compact support and any 
bounded continuous function <j), 

E[Tr[/i(Afjv)</'(AAr)]] = - lini ^3 j ¥.{Tr[GN{t + iy)HAN)])h{t)dt 

y^0+ TT J 

where Gn{z) ~ {zIn — M^)^^. 

Proof Let us denote by Py the Poisson kernel 



We have 



h(x) — lim h*Py(x) 



lim - [ ^^^^^ — ^dt 

lim i f^^^dt. 

y^0+ TT J X- ly-t 



Thus, for any fixed N , 



h(MN)^~ lim - / •^GN(t + iy)h(t)dt, 

y^0+ TT J 

and since \\h * -Py||oo < ll^lloo we have || J 5G'Ar(t + iy)h{t)dt\\ < ||/i||oo- Then, 
the result readily follows by dominated convergence Theorem and Fubini's The- 
orem. □ 

Let J7 be a unitary matrix and 

£i = diag(7i,...,7Ar) 

such that 

An = U*DU 

Let G stand for Gat and g stand for 5;^lsd- Consider G — UGU*. For any 
continuous function 0, 

N 



TY[GMr.{z)<p{AN)] = ^(/)(7fc)Gfcfc(z). 



fe=i 

The following result is fundamental in our approach. 
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Proposition 6.2. There is a polynomial P with nonnegative coefficients, a se- 
quence UN of nonnegative real numbers converging to zero when N goes to infin- 



ity and some nonnegative integer number a, such that for any k in {1, . 

for allzeC\ 

E(Gfefe(z)) -l>fc(z) + Afe,jvW, 



,N}, 
(6.2) 



with 

where 



\Ak,N{z)\ < {l + \z\rP{\^z\-^)aN, 



z-yk{l-c+czg{z)) z(l-7fcFi'j' (i)) 



tf Mn = M^, 
if Mn = MS. 



Note that ^k{z) is well defined for any z e C \ M since 

f 



\^[z-a^g{z)-^k]\ = Mz)\ l + 
|3[z-7fc(l-c+cz5(z))]| = |3(z)| 



1 + C7fc 



jd^cr ffl v{x) 



> |5(z)| > 0, (6.3) 



> |3(2)| > 0. 
(6.4) 



According to (17. 3p and Proposition 17.11 there exists a polynomial P with 
nonnegative coefficients and a sequence of nonnegative real numbers con- 
verging to zero when N goes to infinity such that, for any k in {!,..., N}, for 
any z e C \ M 



(6.5) 



with 
where 



\Rk,N{z)\ < {l + \z\fP(\Qz\-')aN, 



if Mn = Af]f , 



if M. 



N 



In order to deduce Proposition 16.21 we will need the following description of 
the convergence of gniz) towards .g(z). 

Proposition 6.3. There exists a polynomial R with nonnegative coefficients, a 
sequence of positive numbers converging towards zero and some nonnegative 
integer number a such that, for aZZ z e C \ M, 



\gN{z)-g{z)\<{l + \z\rR{\^z\~')aN. 



(6.6) 



Proof: 1) The deformed Wigner model case. 

Denote by the Stieltjes transform of /i(jffl/iyi„. Since we have already proved 
in [23] that there exists a polynomial S with nonnegative coefficients such that 
for all z G C \ R, 

S{\^z\~^) 



\gN{z) - gN{z)\ < 



N 



(6.7) 
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the result will readily follow if we prove that there exists a polynomial T with 
nonnegative coefficients and a sequence b]\[ of positive numbers converging to- 
wards zero such that, for all z G C"*", 

\gN{z)-giz)\<Ti\'^z\-')bN. (6.8) 

The proof of (j6.8|) follows the lines of Section 4 in [24|. For a fixed z £ C^, 
according to Proposition [X^l we have the subordination equations: 

9n{z) = 9^.^ (^)) = - ^^~gN{z)), (6.9) 

giz) = gAFi'^iiz)) = gAz - ^'g(^)). (6.10) 

Moreover, using Lemma [7.71 and 3(z — a'^g{z)) > 32 , we deduce from (|6.10p 
that 

giz)^g^,Jz-a'giz)) + AN(z) (6.11) 

with 

\An{z)\<vn{1)Pi{\^z\-'), 

where Pi is a polynomial with nonnegative coefficients and vn{1) is a sequence 

of positive numbers converging towards zero. 

Since z — a^g[z) € C+, z' g C is well-defined by the formula : 

z' :== H„^f,^^{z-(j'^g{z)), 

where Hc^^ij^^ is defined by p.3p replacing v by ^.An- Oho has 

N'-^l = \-(^'^{9{z)-9t,A^{z-c''^9{z)))\ 
< a\N{l)Pii\^z\-'). 



If 



or equivalently 



^ < aV(l)Pi(|Q.|-^), 
1 < 2a2|3z|-iPi(|3z|-i)«Ar(l), (6.12) 



|5(^) - .9w(^)l < 



< 4a2|3z|-2pi(|3z|-i)t;jv(l). 



If 



one has 



M > a\^{m{\^zn, 



\^z\ 
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which imphes 5z' > ^ and therefore z' G C"*" . Hence, according to p.4p 
it follows that z — a^giz) G ^a,iiA^ (where r^o-.^Ajv defined by (|3.2I 
replacing v by /i^iv) so that i^i"^^^ (z') = 2; — (7^(7(2). 
Thus, the approximative equation (|6.1ip may be rewritten 

and then, using the subordination equation (I6.9P 

5(2) = 5iv(z') + AAr(z). 

Moreover, 



Hence 



(z' — x)(z — a:) 



\3{z) - ~aN{z)\ < \g{z)-gN{z')\ + \gN{z')-gN{z)\ 
< i2a^\^z\-^ + l)vNil)Pi{\^z\-^) 

Finally we get that for all z E C+, 

\g{z) - ~gN{z)\ < (4a2|3zr2 + 

so that (|6.6p is satisfied in the deformed Wigner model setting with — vn{1) 
and R{x) = (4cr2a;2 + l)Pi(a:), a = 0. 

2) The sample covariance matrix setting 

Let z be in C+ . Note that it is obviously equivalent to prove such an estimation 



for 



g^iz) - gT^,Az) 



where 



1-^ N 
gM) = ^ + —gN{z) 



3.N- ' z p 

is the expected value of the Stieltjes transform of the spectral measure of Mfr = 
^B'^AnBn. In the following any Pi will denote a polynomial with nonnegative 
coefficients and aAr(i) will denote a sequence of nonnegative numbers converging 
towards zero when N goes to infinity. Letting the sum running over k in (j7.5p 
and dividing by TV we have 

J z{l-tgj^{z)) 

where 

|Aw(z)| < (l + |z|)2Pi(|9z|-i)aAr(l). 
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It readily follows that 

where Zn_ is defined by (I3.12p replacing v by /i^i and c by — . Then using 
Lemma [7T51 we deduce that 

^f.M.„(5jvW) = ^ + ^^W (6-13) 

where for all large N 

\Rn{z)\ < {l + \z\fP2{\^z\-^)aN{l) 
On the other hand, using ()7.22p and Lemma [7?H1 we have 

2f ^ + Qn{z) (6.14) 

where 

IQjvWI < (l + |z|rP3(|5^r')ajv(2) 

for some nonnegative integer number q. We readily deduce from (j6.13p and 
(|6ll| that 

Zigj^iz)) ^ z + Tn{z) 

where 

IT^WI < {l + \z\rP4i\^z\-')aNm 

for some nonnegative integer number a. 
Set 

z'=Z(5^(z)). 

• If 

4^<(i + kirP4(i5zr^w(3), 

or equivalently 

1 < 2|9z|-i(l + |z|rP4(|5z|-i)a^(3), 

then 

2 



< 4|3zr2(i + |;^|)"P4(|3;^pi)aj^(3). 

If 



> {l + \z\rPi{\^z\-')aN{S), 



2 

one has : 
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which impUes JJz' > ^ and therefore z' G C+. Note that g^iz) satisfied 
the equation 



Z 



and since gr^ ^ (z ) is the unique solution in of the latter equation, we 
can deduce that gr^ ^^{z ) — g^{z). 



Hence 



5^(2) - ffr,,„ {z) = gr,,„ {Z ) - 5r,,„ {z) 

< |5zri|3?z'ri|z-z'i 

< 2\^z\-\l + \z\rP4{\Qz\-^)aN{3). 



Finally we get that for all z G C+, 

g^iz) - grU^)\ < 413^1-2(1 + |z|)"P4(|9z|-^)ajv(3) 
so that (j6.6p is satisfied in the sample covariance matrix setting . 
□ 

Now, Proposition 16.21 readily follows from (16.51) and Proposition 16.31 using 
(IHni), (EH) and dZll) and 1^. □ 

Thus, for any I = 1, . . . , J, (j6.ip and Proposition 16.21 yield that for all large 
TV, for aU z G C \ M, 



E (Tr [Gm„ {z)f„j{AN)]) - Mz) + A^(z) 
where (pi is the following analytic function on C \ R: 



(6.15) 



Mz) = 



- if Mat = M^, 



z-(T^g{z)-ei 

ki _ 

z-e,{l-c+czg(z)) 



if Mn - M^, 



and 



|A^(z)|<a^(l + |z|rF(— ) 



for some polynomial P with nonnegative coefficients, some sequence otv of pos- 
itive real numbers converging to zero when N goes to infinity and some non- 
negative integer number a. 
According to Lemma |8.5[ we have 



so that 



limsup (oat) "'^I I hs.j{t)A]y(t + iy)dt\ < +00 



lim limsupl / hg j(t)AN{t + iy)dt\ = 0. 
^+00 J 



N 



(6.16) 
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Lemma 6.4. Let 9j be in Qo- 

(1) Set pe^ = H{0^). If0iee\ {6^}, the map (a;, y) <^ F^'^}{x + iy) - 6i does 
not vanish on [pe^ — 2(5; pg. + 25] x M. 

The only vanishing point in [pg. — 2(5; pg. + 2(5] x M o/ the map (x, y) i— >■ 
F^'^l{x + iy)-ej IS (pe^,0). 

(2) Setpg^ = Z(^). If 01 e e\{0j}, the map {x,y) ^ (x + ^y)(l-0^g,^_„(a; + 
iy)) does not vanish on [pg. — 25] pg. + 25] x M. 

The only vanishing point in [pg. — 25] pg. + 25] x M of the map {x, y) i— > 
(x + iy){l - 6jgr, ,Xx + iy)) is (pe^-,0). 

Proof: Note that if y 7^ 0, for any a;, the imaginary part of Fa'^} {x + iy) — 61 
and 1 — OigT^ „(x + iy) is nonnuU so that we will focus on the case y = 0. 
Proof of (1): ' 

• Assume Oi ^ 80. First, if H'{Oi) < 0, according to (I3.5p . 6'/ does not 
belong to Fa'^liW) so that the conclusion of Lemma [531(1) is true. 

Now assume that H'iOi) = 0. According to 9i G dQa,,. = i^i"j(K), 

and, by Proposition I3.2[ Fi°j(a;) — 0; = implies x — H{9i). For any 
u € 0'^°'\ we have H{6i) ^ H{u). Indeed, for any u € O^"), there exists 
Wi,W2 such that [iii;u2] C O^"-' and ui < u < U2- Since is globally 
nondecreasing on {v S'^ supp {v), H'{v) > 0} (see Remark l3.3p . we have if 
01 < u, H{9i) < H{ui) < H{u) and if Oi > u, H{u) < H{u2) < H{9i). It 
follows, according to (|4.ip . that H{6i) belongs to supp(/^fflcr) and therefore 
cannot belong to [pg^ — 25] pg. + 25] so that the conclusion of Lemma [631 
(1) is true. 

• Let us consider now, 61 E Gq. By Remark 13.21 and Proposition 13.21 
Fa'^^{x) — 9i = imphcs x — H(9i) = pgi- li I j, pe, does not be- 
long to [pgj — 25] pe^ + 25] and the proof of Lemma (1) is complete. 

Proof of (2): 

First, note that ^ [pg^ - 25] pg^ + 25]. 

• Assume 9i ^ 9o. First, if Z (^) > 0, according to Remark [XH ^ does 
not belong to gr^ ,^(M \ {0}) so that the conclusion of Lemma [6.41 (2) is 
true. 

Now assume that Z (j-^) = 0. By Remark 13.41 1 — Oigr^ ,^{x) = with 
X nonnull implies x = Z{j^). In particular, if 'Z(^) = 0, the conclusion 
of Lemma 16.41 (2) is true since ^ [pg^ — 25] pg. + 25]. Hence, in the 
following, we will deal with 9i such that Z[^) ^ 0. For any u £ 
we have Z{j^) ^ ■2(i). Indeed, for any u e O^™), there exists Ui,M2 
such that [ui;u2] C O^™) and ui < u < U2. Since a; i-> 2(i) is globally 
nondecreasing on {v ^ 0, v supp (j/), Z'(i) < 0} (see Remark we 
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have if Oi < u, Z{j-J < Z{^J < ^(i), and if 9i > u, ^(i) < Z{^J < 
Z(^). It follows, according to (|4.2p . that -Z(Jj) belongs to supp (r^iy) 
and therefore cannot belong to [pe^ — 2S; pg. + 25] so that the conclusion 
of Lemma 16.41 (2) is true. 



• Now, let us consider 6i E 9o. By Remark 13.41 1 — 6igr^^{x) = with 
X nonnuU implies x = — pg^. If I ^ j, pg^ does not belong to 

[pg^ — 26; pg. + 25] and the proof of Lemma [6.41 (2) is complete. □ 

Let 9j be in Qo- According to Lemma |6.4[ 0/ is an analytic function on ]pg — 
25] pg. +2(5[xM for I ^ j and 4>3 is an analytic function on ]pg. —25] pg. +2(5[xM\ 
{(P9j,0)}. Moreover, for any I, <f)i{z) — (t)i{z). We have 

If 1 /-Pfj-f 

- ^(I>i{t + iy)hs,j{t)dt = — / hs^j{t)[(l)i{t + iy)-<l>i{t-iy)]dt 

TTJ 2nrjp^^_s 

hs,]{t) [4>i{t + iy) - (t>i{t- iy)] dt 



1 

2iTT .lp,^+l 



1 fPOj + 2 

Ai + Aa + A3. 



We immediately get that limj,^o+ Ai = and limj^_j.o+ A2 = 0. Now, 

A3 = w- [ ' ' [Mt + w)-Mt-w)]dt 



2iTT 

1 

2iTT 



4>i{z)dz 



1 5 

If" 5 

As,! + A3_2 + A3^3 



where "fj,y,s is the clockwise oriented rectangular with corners pg^ — ^ — iy, 
pg. - 1 +iy, pg. + ^+iy and pg. + 1 -ly. We immediately get that hmj^^o+ A3, 2 = 
and limj^_j.o+ ^3,3 — 0- Moreover, for all y, 

As,! = / <l)i{z)dz = -Res {(pupgA 
2in J 

with 

Res {(pi,pg,) = if Z 7^ j. 
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and 



w 



Thus 



lim - I hsAt)'i4>i{t + iy)dt = Qiil^j, (6.17) 

-)-0+ TT J 



and 



1 



-kjH'{0j) if Mat = Af]f 



lim-//i5,,(i)5</.,(t + zy)dt=<^ 2^ (6.18) 

Finally from (|05l) . (|06l) (|08l) and ([6T7l) we deduce that 

lim lim [e (Tr [GA/„(t + iy)f^,i{AN)]) hs,jit)dt = if / ^ j, 

A'-i.+oo y-iO+ TT J 

and 



limjv-^+oo limj,^o+ i^/ ^ (Tr [Gmn + iy)/»?,j(^w)]) hs,j{t)dt 
-kjH'{0j) ifMA,=M]f 
ifMAr = M^. 

Then, Proposition 14. II follows by Proposition 16. II and Lemma [6.31 



7 Technical results specific to each model 

Lemma 7.1. 

(1) For any N x N Hermitian matrix X, 

{(^(^0)i<.<^ (^/25^X(^,J))^<^^^.<^ (y23X(*, j))i<,<,.<^} 

^Tr[/l5,,(X + ^jv)/^,i(AAr)] 

is Lipschitz with constant bounded by v^ll^d'.ill-Lip- 

(2) For any N x p matrix B, 

{(5iB(z,j), ^Bii,j)) 

l<i<N,l<j<p 

is Lipschitz with constant bounded by \/kiV2C\\hs,j\\Lip where hs_j{x) 
hsj{x'^) and C — supjy ||^Af||- 
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Proof Given two N x N Hcrmitian matrices X and X , we have (using Lemma 
that 



Tr [hs,,iX + AN)U,iiAN)] - Tr [hs,j{X' + An)Ui{An) 

Lip 

and (1) foUows since ||/r;,z(^Ar)||2 — \fh.. 

To prove (2) we will make use of a useful observation already made in [34] . Let 
us introduce the (N + p) x (N + p) matrices 



Ml 



N+p 



p Ojjx Af 



It is easy to see that 



Tr 



hs^,{AlBB*Al)f„^iiAN) 



Tr 



hs,j{MN+p{B))MN+p 



where hsj{x) = hsj{x'^). Note that since hsj is a C°° compactly supported 
function, hsj is obviously a Lipschitz function. Hence 



Tr 



hsAAlBB*Al)f.,AAN) 



Tr 



hsAAlB'iB YAD/^Mn) 



Tr 



hs,j{MN+p{B))JVN^ 



-Tr 



h5j{MN+p{B'))AfN+p 



< \\M'n+p\\2 h5j{MN+p{B))-hsj{MN+p{B)) 



< 



Lip 



M N+p{B) — Mn+p{B ) 



(7.1) 



where we used Lemma l8.2l in the last line. Now, 

2 



= 2Tr 



Mn+p{B)-Mn+p{B ) 

< 2Pjv 

< 2C 

(2) readily follows from ffA) and fL^ . □ 

We have proved in Lemma 3.3 [24] that Vz G C \ 

1 



{B-B YAnIB^B 

, 2 
2 

, 2 



(7.2) 



(z-a2g]^(z)-7.) 



+ Rk,N{z), 



(7.3) 
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with 

^ p(iszr^) 

|^fc,Af(2^j| < 

for some polynomial P with nonnegative coefficients. Note that 

\-S{z-a'g^{z)-jk)\>\^z\. (7.4) 

We are going to establish the following similar result for the sample covariance 
matrix setting using many ideas from [7]. 

Proposition 7.1. There exists a polynomial P with nonnegative coefficients 
and a sequence aj^ of nonnegative real numbers converging to zero when N goes 
to infinity such that, for any k in {1, . . . , N} , any z m C \ 

with 

\RkAz)\ < (l + |z|)2p(|3z|-i)a^. 

Proof Let J be a iV x iV matrix and w be a vector in such that J and 
J + uu* are invertible then 

u* J^^uu* {J + uu*) ^ = u* J^^ {uu* + J) {J + uu*) ^ — u* {J + uu*) ^ 

— u* J^^ ~ u* {J + uu*) ^ 

so that 

j-i 

u*(J + uu*) —- — ;— . (7.6) 

^ ' l + u*J-^u ^ ' 

Hence if Wi, . . . , Up are p vectors and X = 'Y^i=\ ^i""! i denoting by Gx{z) the 
resolvent {zl — X)^^ , (|7.6p yields that for any i G {1, . . . for any z e C \ K, 



Ui 



u^Gxiz) = ^ = (7.7) 

1 - U* (zl - UlU* 



Multiplying (|7.7I) by Ui and summing in i yields 



P u, 



MU* (zI-Y^i^.uiu*) 

XGx{z)^Y. 7 (7-8) 

=1 1 - u* (zl ~ Y,i^^ uiu*^ 



From (|7.8p and the resolvent identity 

-I + zGxiz) ^ XGxiz), 
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we deduce that 



UiU. 



kk 



i=l z 



Noticing that 
and that 



D2UXiU*D2 



(7.9) 



(7.10) 



1 ^ 



1=1 



where Ui = -^D^Uxi and Xi is the ith column of Bat, we deduce from (I7.9P 
that 



D^Ux,x*U*D^ (^zl - i J2i_^^ DiUxix*U*D^ 



kk 



^=l zll- ^x*U*Dh (^zl - i DiUxix*U*Di^ ' D^Ux, 



(7.11) 



Set for i = 1, . . . ,p, 



and 



1 



M 



(i) 
N 



Note that the y^'s are i.i.d and that yi is independent of M^'. Note also that 
(|7.1ip can be rewritten as follows 



Gkki^) — — ^ - 



D^-Ux,x*Al 








H 











(7.12) 



Now applying (|7.9p with Uj = y^ and X = Af^, summing on fc and dividing by 
N we have 



trjv 



(Cms (2) 



1,1^ 2/*(z/-A^«)"\, 



z N ■ 



1 pi 1 



r^-7.13) 



^ z|l-y* (z/~A/«) 
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Let us define the p x p matrix 



Since 



tlr, 



s 1 



1 - — N 

(Gm^ (z)) = + -trjv (Gm. (^)) , (7.14) 

we deduce from (17. 13^ that 

1 ^ 

trjv (Gms(z)) 



(7.15) 



Following the ideas of Section 6.4.1 of [Tj, we are going to establish the following 
preliminary lemma. 

Lemma 7.2. There exists a constant K > Q and a sequence of nonnegative 
numbers ajq converging to zero when N goes to infinity such that for each i = 
l,...,p, Vz e C\R, 



z<i l-y*(z/-M«) y, 



< K- 



TON- 



L2 



We have from (j7.15p 
trp (g'm^(^)^ 



1 

|l-y-(2:/-A/<;')"^.| 







VI - 


- ; 




-i 

Vi 










w 


l-2/;(z/-M«) 





Lemma 7.3. i^or any N x N positive semidefinite matrix H , any vector v in 
and any z m C \ M, 



1 



< 



1 



\z{l-v*{zl - H)-^v}\ - |!3z 
Proof: 

^{zv*{zi - ny^v} = ^ 



{zv* {zl - H)-\ ~ zv* {zl - H)-\} 
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Hence 

\'^[z{l-v*{zl - H)-^v}]\ = |3z 
and Lemma [7.31 follows. □ 

According to Lemma |7.3[ for any I and i in {1, . . . ,p} 

1 



l + -^v*{I--H)-^H{I-^H) 



Hence 



tr, 



1 - y* [zl - k4^) yi\\l-yl (zl - M«) 



(Gms (z) 



< 



< 



\z\ 1 



- J2 y*i {^i - m^n) yi - y't {^i - y^ 



L2 



We have 



y;(zI-A4^) \i-y*[zI-N4^) \, 



y\[zl-M'^^~) \y,--Tr 



V 



[zI-M^) 



A 



N 



+ iTr 
P 

+ iTr 
P 



zl - M 



(0 



-1 



N ) 

-1 



zl - M 



A 
An 



-iTr 
P 



zI-a4^] An 



y*(zI~A4^) \, 



Wc have 



|A 



IA\ 



< 



1 

-Tr 

P 



zl -M 







ixr 


[{ 


P 





z/ - Af 



\Qz\p 

where we used Lemma 6.9 [7") in the last line. 
Now we have for any / = 1, . . . , p, 



W\ \.. -'^^* Ai f-,T AfW^ ' 



( zl - M';> ) yi = -xIAl [ zl - Af^ 



A 
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so that according to Proposition 18 . 1 1 in the Appendix, for any I = 1, . . . ,p, 



P y/P 



It follows that 



tr 



z - y* [zl - 
and the proof of Lemma [72] is complete. □ 



< 



2C\z\ / 1 



p Vp, 



L2 



Lemma 7.4. There exists a constant K > such that, for any k — 1, . . . ,N, 

for any i — I, . . . ,p and any z in C \ R, 



DiUxiX*Al (^zl- M 



Proof: Note that 
DiUx^x*A% ( 



zl - ) U* 









)-'"■] 




< 




kk 


L2 



K 



= TTD^UxiX*A}j [ zl - M^^ 



kk 



U*Ei 



kk 



x*Al [zI-A^^y 



Thus, according to Proposition 18. II in the Appendix, 



DiUx^x*Al {zl - a4') U* 



kk 



-TrAj (zI-M^'y 



U*EkkD^Ux,. 



U*EkkD2U 



< K 
Since moreover 



TtAI (z/ - 



(i) 



U* EkkDEi 



kU{z 



rii) 
'-N 



A 



N 



< 



c 



-^z 



TrAl (zI-M^) 



we deduce that 



D^UxiX 



:4( 



zI-M 



WEkkD-^U 



< 



C 



-~jz 













kk 



< 



L2 



2C 



□ 



We will need this last lemma concerning the variance of tr^ \^Gj^,js^ {z 

Lemma 7.5. There exists some polynomial P with nonnegative coefficients such 
that, Vz e C \ M, 



trp (Gm^W) -E(trp(GMs(z) 



1 
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Proof: Let us define * : M^bxJV) ^ Mnxp{C) by 

{xij,yij,i = l,...,N,j = l,...,p} ^ ^ ^ {xij + \/^yij) Eij . 

i=l,...,N j=l,...,p 

Let be a smooth complex function on M^xpi'C) and define the complex 
function / on M^lpxJV) getting / = F o Then, 



||grad/(M) 



sup 

VeMNxp{C),TrVV = l 



lF{^{u)+tV)U=o 



We have Bn = *(3*((BAr)ij), 3?((BAr)y ), 1 < z < iV, 1 < j < p) where the 

distribution of {V2'St{{BN)ij),V2'^{{BN)ij),l < i < N,l < j < p} satisfies a 

Poincare inequality with constant Cpj. 

Hence consider F : B ^ tY^izlN - A]^^^A%)-'^. 

Let V G Mjvxp(C) such that TrVV* = I. 

^^F{B + tV)\t=o = ■^Tt{Gms{z)aI,VB^aI,Gj^s{z)) 

+^Tr(GM. iz)AlBV*AiGMS {z)). (7.16) 
By Cauchy-Schwartz inequality, we have 

^Tr(GM. {z)AIVB*^AIGms {zj) 



< 



1 

7^ 



Tr- 



1 

B*pfA^ 


Gm^ (^) 


2 

An 


Gm^ (^) 


2 1 -| 


1 
2 

{TiVV*)i 


P 



tVNM^ 



Gm^{^) An Gms{z) 



Since by tlie resolvent identity 

MfiGMS^{z) = -In + zGms, 

we have 



tr;v-^j 



A 



N 



Gms {z) 



-tr nG MS (z) An Gms{z) 



+ ZtVN 



Gms{z) An Gms{z) 



we can deduce that 



trAfM^ 



GMg{z) An Gms{z) 



< 



\A 



N 



< 



C{\z\ + l)P{\Qz\-'), 
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where P is a polynomial with non negative coefficients. Hence 



^Tr(GMS {z)AivB*^AlGMS [z)) 



< 



1 



C{\z\ + l)P{\-sz\-') 



Since a similar upper bound can be obtained in the same way for the second 
term on the right hand side of (|7.16l) we deduce that 



E I I sup 

VeMNxpiC),TrVV' = l 



dt 



FiBN + tV)\t=o 



< 



2C 



(|z|+l)P(|5z|-i) 



Therefore, Poincare inequality yields 

tr^ (Gm. (^)) - E (tr^r (Gms (z))) < ^(|z| + ifQ 



Np 

where Q is a polynomial with non negative coefficients. Now, since 

N 
P 

Lemma [731 follows. □ 



tip (g^sJz))~E (tip (GmsJz))) = ^ [tvN (Gm^(z)) - E {tvN {GmsJz))) 



Using (|7.12p , we have for any z in C \ 1 

p 



E 



(Gffe(z)) - - + -^E(ci>,,fc)E(trpGM^(z) 
1 ^ 

+ - ^ E [tTpGM% (z) - E (trpGM^ (z)) } 
1 ^ 



i=l 



trpGjv/s (z) 



where 



D^Ux^x*A^ [zl ~ M)^' ] U* 



kk 



By Cauchy-Schwartz inequality, using Lemmas 17.41 and 17.21 we easily have that 
there exists a constant K and a sequence of nonnegative numbers converging 
towards zero when N goes to infinity such that for any k — 1, . . . , 



1 ^ 




-Ye 









K\z\ 



42 



By Cauchy-Schwartz inequality, using Lemmas 17.41 and 17.51 we also have that 
there exists a polynomial P with nonnegative coefficients such that 



1 ^ 

- ^ E {trpG^^ (z) - E (ti-pGMS {z)) } 



<l(|z| + l)2F(|3zri). 



Thus 



E I 



(Gf,(z)) =i + i^E(<i>,,fe)E(trpGM^(z)) +A^(/c) (7.17) 



where there exists a polynomial Q with nonnegative coefficients and a sequence 
of nonnegative numbers converging towards zero when N goes to infinity 
such that, for any k — 1, . . . ,N , 

|Ajv(fc)| < {\z\ + lfQ{\<^z\-^)hN. 

Now, one can easily see that 

E($,,fc) - 7fcE([;7(z/-Af«)-i;7*]fefe) 



(7.18) 



where 



Lemma 7.6. There exists a polynomial P with nonnegative coefficients such 
that for any i — 1, . . . ,p, any k — 1, . . . ,N, any z G C\M., 



E 



(Gf,(z))-E([(z/-^ 



UlU*i) \k] 



<i(|z| + l)P(|3z|-i). 



Proof: Remember that according to ()7.10p . 



E(Gffc(z))=E([(z/-£u,wn"']fcfc)- 



1=1 



By the formula (3.3.4) in [7], we have 
p 

[{zi - ^ uiuiy%k = [{zi - ^ uiu*iy\k H 

1=1 li^i 1 — U* 



1pi,k 



UlU, 



where 



Zl — UlUi 



kk 
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Noticing that 



we have by Proposition 18.11 that 



V'^,fc - ^TrD (zl - J^i^t ^kk [zl ~ E/^» 



L2 



< E J Tr2?(z/ - uiutr^EkkizI - uiu*iY\zI - ^ umtr^ Ekk{zl - ^ 
<r CK 

Using also Lemma [731 we readily have that 



UlUi 



< 



G'kkiz) -K 



CK 



kk 



E 



TrDizI ~ J2 uiu*i)-'Ekk{zI - ^ uiu*i)-' 



Since 



TtD{zI ~ Y uiu*i)-^Ekk{zI - Y uiu^y^ 

Lemma [7.61 readilv follows. □ 
Hence (|7.18p and Lemma |L6] yield 

E(ci>,,fc)=7feE(Gffe(z)) +n,k 



< 



C 



with \Ti_k\ < ^ {\z\ + 1) P(|3z|~^) and thus, using equation (|7.17p . there exists 
a polynomial Q with nonnegative coefficients and a sequence of nonnegative 
numbers ajy converging towards zero when N goes to infinity such that for any 
fc = l,...,7V, 



E 



with 
Thus 



(Gf,(^)) = ^ + 7/cE (Gf,(z)) E (trpGM^(z)) + ^k 

lai < {\z\ + lfQ{\^z\'')aM. 
[z - jkzE (trpGM^ (z)) } E (cfjz)) = 1 + z^- 



(7.19) 
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Using the resolvent identity 
we can easily see that 

Hence 

= |9z|{l + 7fctrpGMs(z)*M^GMs(z)} > |5z|. (7.20) 
Thus (fTTOl) yields that 

E (gL(z)) = ^ + 4 

zEUrpGMsJz)) 



with 

\Q<^{\z\ + lfQ{\^z\-')a^. 



Proposition 17.11 readily follows since fsee ()7.14p ) we have 



E (trpG^s (z)) - -E (tiNGMsiz)) + - 



N 



□ 



To prove Proposition 16.31 in the previous section, we need the following de- 
scription, when the matrix An and the measure v satisfied Assumption A in 
the Introduction, of the convergence of g^.^^^ (z) towards g^iz) and of the con- 
vergence of Zri (z) towards Z(z) (dealing in the last case with measures on 

[0; -l-oo[) where Zn_ (z) is defined by p.l2p replacing v by and c by — . 

Lemma 7.7. Under Assumption A, there exists polynomials Pi and P2 with 
nonnegative coefficients and sequences vn{^) andvN(2) of positive numbers con- 
verging towards zero such that for all z Cz C \ M, 

|5m.„ W - < Pi{\^z\-^)vn{1), (7.21) 

\Z. (z) ~ Z{z)\ < {\z\ + l)'P2{\^z\-')vNi2), (7.22) 

Proof: Let us introduce 

^ N-r 



45 



Let us fix e > 0. According to the assumption (|2.ip . for A'" large all the Pj{N) 
are in the set {a:, (i(a;, supp v) < e}. Moreover, {x,d{x,supp v) < e} may be 
covered by a finite number of disjoint intervals /i(e) with diameter smaller 
than e, of the form ]ai(e); 6i(e)] where ai(e) and 6i(e) are two continuity points 
of the distribution function of v. Note that for any i = 1, . . . , rig, when N goes 
to infinity, 

VN{h{e)) ^ i^{h{e)). 



Since < j^\'^A 1, and 



J ]_ 

TV 7V-r 



Y^JV-r 1 

2^1 = 1 



we focus on the difference gv^{z) — gy{z). Similarly, since |;^X]i=i i-e-z I — 



;^|9z| \ and 



I ]_ 

N N-r 



Z^7=l 1 



'jfjNjzi < "^l^^l we focus on the differ- 



ence Zjv 0„{z) — -Z(z) where Zn_ - is defined by p.l2p replacing v by i>Ar and 
cby ^ . 



E 



iV-r ^ z-/3,(7V) 



-dv(x) 



E 

ft (7V)6/.(e) 



iV-r _ , , z- f3j{N) 



E 

1,1.(7, (e))=0 

E ^ 

^ N -r 



E 



E 

i,!.(/,(e))>0 



pAr(/i(e)) 



Ai + A2 + A3. 



- 1 



-dv{x) 



where 



|A2|<e ^ ;>Ar(/,(e))|3zr2<e|3z|-2, 

i,J.(/i(e))>0 

|A3|< 5] |£>^(/,(e))-K/.W)l|3^r^ 

i,J.(/i(£))>0 



Hence 



and then 



lim sup sup 

zeC\R 



< e. 
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Since this is true for any e > 0, we get that 

hm sup {{\Qz\-' + \Qzry'\goAz)-9.{z)\}^0 
which yields (H^B)- 

Now, since moreover |Ziv -^(z) — Zc^Ofj{z)\ < |y — c||3z|^"'" we will study 
2c,i>N{z) - Z{z). Similarly, 



7V-r ^ 1 



- ■ fii{N)z 



where 



Ai + Aa + A3. 



»,i.(7,(e))=0 



i,!^(7,(€))>0 



z 



|A3|< y |i)^(/.(6))-K/.(^))l|3^|-^ 
i,i/(/i(e))>0 

Hence 

|i[Z,,,„(z)-Z(z)]|< (Izn^zr^ + l^zl-i) (^e + f;|i>^(/,(e))-K/.(e))| 



and then 



hmsup sup ((|zn3z|-2 + |3^|-i) < 
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Since this is true for any e > 0, we get that 



lim sup 



Af— i.+oo 



2eC\R 



{{\z\'\^z\-' + \^z\-Y' - Z(z)|} = 

and (fr22)) follows. □ 

In the sample covariance matrix setting we will need the following upper 
bound of ^, }, .^ where 



g^(z) = E (trpGM^(z)) - (tr^G^s (z)) + 



l_iv 



with 



1 



Mat — -B*jqANBisi. 
P 



Lemma 7.8. There exists a constant C_ such that for any z in C\] 

1 



<cii+\z\r\-sz\-' 



Proof: Note that 



mg%{z))\ = |5z|E 



\z — a;p 



Now, for any x in the spectrum of Mf, 



.ATI 



\z - x\' < 2(|zp + WmU') < 2(|zp + \\ANf\\-B*j,BNf) 

P 



so that, with C — sup^ \ \^n\ 



' f dfiM^ixY 


> E 


[Jr \z - J 





2(|z|2 + C2||iS]^S^P) 



1 D* D 



According to Theorem 5.11 in [7j, 
by the dominated convergence Theorem we can deduce that for all large A'', 



•^(l + T;)^ + Oa.s,Ar(l) SO that 



E 



dflM^ {x) 



> 



where Ci > [Cc(l + ^f] ■ Therefore 



< 



2(|zP + Ci) 



2(|z|2 + Gi) 



so that Lemma [7.81 readily follows. □ 
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8 Appendix 

8.1 Poincare inequality and concentration inequalities 

We first derive in tliis section concentration inequalities based on the Poincare 
inequality. We refer the reader to the book [2] . A probability measure /x on IR is 
said to satisfy the Poincare inequality with constant Cpi if for any function 
/ : R -> C such that / and /' are in L'^ip), 



We refer the reader to [21] for a characterization of the measures on R which 
satisfy a Poincare inequality. 

Remark 8.1. If the law of a random variable X satisfies the Poincare inequality 
with constant C'pi then, for any fixed a ^ 0, the law of aX satisfies the Poincare 
inequality with constant a^Cpi. 

If a probability measure fi on W satisfies the Poincare inequality with constant 
Cpi then the product measure fi^^^ on R*^ satisfies the Poincare inequality with 
constant Cpj in the sense that for any differentiate function F such that F and 
its gradient VF are in L^(^^*^), 



An important consequence of the Poincare inequality is the following con- 
centration result. 

Lemma 8.1. Lemma 4.^.3 and Exercise 4-4-5 in or Chapter 3 in \41^ - 
Let T be a probability measure on R^ which satisfies a Poincare inequality with 
constant Cpj. Then there exists Ki > and K2 > such that, for any Lipschitz 
function F on with Lipschitz constant \F\Lip, 



8.2 Technical tools 

We need the following result on the extension of Lipschitz functions on R to the 
Hermitian matrices. 

Lemma 8.2. (see \27^ ) Let f be a real Cc-Lipschitz function on R. Then its 
extension on the N x N Hermitian matrices is Cc-Lipschitz with respect to the 




withYif)^ J \f- J fd^i\^d^l. 




with V(/) = / 1/ - / /d/x^A-f pd^^A^ (see Theorem 2.5 in IMI) ■ 




norm \\M\\2 = {Tr{MM*))2. 
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Proof: Let A and B he N x N Hermitian matrices. Let us consider their 
spectral decompositions 



and 

We have 

\\fiB)-fiA)\\l 



B = Y^K{B)P^''\ 

i 

Tr f{UA)fP^^' + E fi>^^iB)rPr 

\ i j 

-2^/(A.(A))/(A,(i?))rr(i^(^'p,(^)) 



-2^/(A.(A))/(A,(i?))rr(p(-^)p,(^)) 

id 

5](/(A,(A)) - /(A,(i?))2rr(p(^)p,(^') 



Now, since we can deduce that 

\\f{B) - f{A)\\l < J2 CliX^iA) \,{B)fTr{P^^^pf^) = Cl\\B A\\lu 

We recall here some useful properties of the resolvent (see [551 

Lemma 8.3. For a N x N Hermitian or symmetric matrix M , for any z € 
C\ Spect(M), we denote by G{z) :— {zIn — M)~^ the resolvent of M . 
Let zeC\R, 

(i) ||G(z)|| < where \\.\\ denotes the operator norm, 

(a) |G(z)y| < |3z|-i for allij = 1,...,N. 
(Hi) Let z e C such that \z\ > ||Af||; we have 

1 



|G(z)|| < 



|z|-||M|| 

We recall here the following classical result due to Weyl. 
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Lemma 8.4. (cf. Theorem 4.3.7 of J^ ) Let B and C be two N x N Hermitian 
matrices. For any pair of integers j, k such that 1 < j, k < N and j + k < N +1, 
we have 

\,+k-i{B + C) < X,iB) + XkiC). 
For any pair of integers j, k such that I < j, k < N and j + k > N + 1, we have 

\j{B) + Afe(C) < Xj+k-N{B + C). 

The following result on quadratic forms is of basic use in the sample co- 
variance matrix setting. Note that, a complex random variable x will be said 
standardized if E(a;) = and E(|xp) = 1. 

Proposition 8.1. (Lemma 2.7 0) Let B — (bij) be a N x N matrix and Y^r be 
a vector of size N which contains i.i.d standardized entries with bounded fourth 
moment. Then there is a constant K > such that 

E\Y;;BYn - TrSp < KTt{BB*). 

The following technical lemma is fundamental in this paper. We refer the 
reader to the Appendix of (35] where it is proved using the ideas of [55] . 

Lemma 8.5. Let h be an analytic function on C \ M which satisfies 

\hiz)\<i\z\+KrP{\-sz\-') 
and if be mC°° (M,R) with compact support. Then, 

limsupl / tp{x)h{x + iy)dx\ < +00. 
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